Papers with linear projections
Why Overfitting Isn’t Always Bad: Retrofitting Cross-Lingual Word Embeddings to Dictionaries (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies only evaluate cross-lingual word embeddings on bilingual lexicon induction (BLI) however, underfitting can hinder generalization to other downstream tasks. |
| Approach: | They retrofit cross-lingual word embeddings to the training dictionary and a synthetic dictionary to improve their results. |
| Outcome: | The proposed method improves accuracy on two downstream tasks, despite underfitting the training dictionary. |
What Happens to a Dataset Transformed by a Projection-based Concept Removal Method? (2024.lrec-main)
Copied to clipboard
| Challenge: | A number of recent methods have used linear projections to remove information about a concept from a language representation. |
| Approach: | They propose to use linear projections to remove a concept from a language representation to create a transformed set of word embeddings. |
| Outcome: | The proposed methods inject strong statistical dependencies into the transformed datasets. |